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PREFACE 

The  broad  range  of  optimization  problems  that  can  be  classified 
as  multistage  decision  processes  are  amenable  to  solution  by  the  tech¬ 
niques  of  dynamic  programming.  This  Memorandum  provides  a  specific 
application  of  the  dynamic-programming  approach  to  solving  such  prob¬ 
lems,  which  arise  in  many  areas  of  scientific  investigation. 

The  present  study  is  an  outgrowth  of  an  investigation  of  border 
infiltration  undertaken  by  The  Rand  Corporation  for  the  Advanced  Re¬ 
search  Projects  Agency.  In  that  investigation,  the  technique  presented 
here  was  applied  to  the  more  limited  problem  of  predicting  infiltration 
routes.  The  model,  however,  has  now  been  generalized  so  that  it  can  be 
applied  to  a  variety  of  problems. 

This  model  is  programmed  for  use  on  JOSS,  Rand's  time-shared,  on¬ 
line  computer  system,  but  it  is  designed  to  be  readily  adaptable  to  other 
on-line  systems.  At  present,  JOSS  is  being  used  by  approximately  20 
agencies  within  the  Department  of  Defense  and  by  numerous  other  organi¬ 
zations,  as  well  as  by  Rand.  And  since  all  of  these  agencies  deal  with 
practical  problems  that  are  structured  with  many  decision  variables  and 
constraints,  this  model  should  prove  widely  useful. 


\ 
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SUMMARY 


This  Memorandum  contains  the  derivation  of  a  dynamic-programming 
model  for  finding  optimal  solutions  to  problems  involving  certain  multi¬ 
stage  decision  processes.  The  model  has  been  implemented  on  JOSS,  and 
instructions  on  its  use  are  also  included. 

The  dynamic-programming  approach  analyzes  an  optimization  problem 
with  various  constraints  and  variables  by  decomposing  the  problem  into 
a  sequence  of  stages  at  which  lower-order  optimization  takes  place. 

The  model  presented  here  encompa' ses  a  va.  ue-iterative  method  which  is 
less  restrictive  and  which  offers  desirable  advantages  over  other  cur¬ 
rently  used  techniques.  One  such  advantage  is  a  reduction  in  the  actual 
amount  of  computer  storage  required  to  reach  an  optimal  solution. 

The  model  is  flexible  and  allows  for  testing  the  sensitivity  of  a 
decision  process  to  changes  in  the  terminal  point  and  thus  in  the  asso¬ 
ciated  coats.  Additional  information  may  be  gained  from  examining  the 
buildup  of  an  optimal  solution,  which  can  also  be  printed  out  if  condi¬ 
tions  permit. 


-vii- 


ACKNOWLEDGMENTS 

It  is  a  pleasure  to  acknowledge  the  helpful  comments  of  C.  F. 
Black,  J.  A.  Lockett,  and  K.  V.  Saunders. 


-ix- 


CONTENTS 

PREFACE  .  iii 

SUMMARY  .  v 

ACKNOWLEDGMENTS  . vii 

Section 

I.  INTRODUCTION  .  1 

II.  THE  MODEL . 2 

III.  THE  JOSS  PROGRAM  .  5 

Appendix 

A.  ILLUSTRATIVE  PROBLEM:  INPUT  AND  OUTPUT .  9 

B.  PROGRAM  LISTING  .  16 


REFERENCES 


19 


-1- 


I .  INTRODUCTION 


The  term  dynamic  programming  is  frequently  applied  to  the  mathe¬ 
matical  analysis  of  problems  in  which  conditions  that  muet  be  satis¬ 
fied  by  an  optimal  time-staged  decision  process  re  to  be  exploited  to 
determine  the  best  course  of  action.  Dynamic  elements  (i.e.,  simulta¬ 
neous  time  considerations)  are  foremost  in  many  types  of  problems  in¬ 
volving  multistage  decisionmaking  over  definite — or  even  indefinite — 

* 

time  horizons. 

Some  of  the  subtle  points  of  dynamic  programing  are  frequently 

in  discussions  of  the  subject.  In  Section  II,  we  shall  attempt 
to  clarify  these  points,  as  they  relate  to  a  class  of  decision  problems 
that  can  be  characterized  by  a  particular  network  system.  This,  then, 
facilitates  the  construction  of  a  model  suitable  for  finding  optimal 
solutions  to  such  problems.  The  principle  of  optimality  used  in  the 
present  model  allows  one  to  find  the  minimum-cost  (shortest)  oath  as 
a  function  of  the  maximum  number  of  arcs  allowed.  (The  unconstrained 
shortest-path  problem  has  been  treated  extensively,  e.g.,  see  Refs. 

1  and  2.) 

Section  III  describes  the  JOSS  implementation  of  the  modex  and 
includes  instructions  for  its  use.  An  illustrative  problem  is  given 
in  Appendix  A,  and  the  program  listing  is  given  in  Appendix  B. 

*A  definite  time  horizon  is  one  in  which  the  number  of  periods  or 
stages  remalnlns  in  s  decision  process  i* **  stipulated. 

**JOSS  is  an  on-line,  time-shared  computer  avstem  developed  at 
Rand.  JOSS  la  the  trademark  and  service  mark  of  The  Rand  Corporation 
for  its  computer  program  and  services  using  that  program. 
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II.  THE  MODEL 


The  class  of  problems  with  which  we  are  concerned  is  defined  as 
follows:  Let  a  decision  process  be  characterized  by  a  network  system 
consisting  of  p  nodes  and  a  collection  of  directed  arcs.  (A  node  is 
merely  a  junction  point  with  incoming  and/or  outgoing  arcs.)  Let  (i,j) 
denote  the  arc  from  node  i  to  node  j,  and  the  amount  be  the  associ¬ 
ated  expense  of  traversing  (i,j).  A  terminal  node,  r,  must  be  specified, 
rhere  is,  however,  no  requirement  that  a  particular  starting  point  be 
specified. 

Given  a  decisionmaking  process  that  can  be  formulated  by  such  a 
network  system,  we  define  an  optimal  solution  to  be  a  path  (from  nodal 
points  in  the  system  to  the  terminal)  that  satisfies  the  following 
principle  of  optimality: 


Regardless  of  the  previous  rationale  used  to  arrive 
at  a  particular  statet  the  remaining  decisions  as 
to  what  path  to  take  en  route  to  the  terminal  must 
themselves  constitute  an  optimal  solution. 


Here  we  let  be  the  present  velue  of  an  optimal  path  from  n~de  1 
to  the  terminal  node  r,  where  optimal  implies  a  path  having  minimal 
total  cost.  Now,  if  an  optimal  path  from  node  i  to  node  r  starts  by 
first  going  to  node  j,  then 


Y 


i 


Y,  +  C 


ij 


(1) 


and 


Y.  ♦  C  . 
k  tk 


(2) 


for  all  k  d  j  in  the  system. 

Equation  (1)  states  that  the  cost  of  an  optimal  path  from  node  i 
to  the  terminal,  r,  which  starts  by  first  going  to  node  j  is  the  sum 
of  the  cost  of  an  optimal  path  from  node  j  to  r  and  the  cost  of  going 
from  nod-  i  to  node  J.  Equation  (2)  insures  that  aSKMtg  the  possible 
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choices  of  paths  to  take  from  node  i,  none  is  better  than  the  one  start¬ 
ing  with  node  j. 

Since  Eqs.  (1)  and  (2)  must  hold  for  every  node  i  different  from 
the  terminal  node  r,  then  must  satisfy  a  set  of  functional  equations, 

Y.  *  minimum  [Y,  +  C..J 
1  <i,J>  J  lj  o> 

the  system 


for  all  i  4  r,  and 


Y  i  0.  (4) 

r 

A  method  of  successive  approximate i  nay  be  used  to  solve  for  the 
p  -  1  unknowns,  Y^  (i  4  r).  Specifically,  a  value-iterative  algorithm 
is  applied.  The  value  of  the  Y^'s  is  initially  set  at  zero,  and  the 
Y^'a  are  then  calculated  as  in  Eq.  (3)  for  every  node  i  4  r  in  the  sys¬ 
tem.  That  is,  the  first  iteration  is  computed  as  follows: 

Y(l,i)  •  minimum  (0  +  C..], 

(i.J)  (5) 

in  the  system 

for  all  l  4  r  with  Y(l,r)  5  0.  The  first  index  on  Y  is  the  iteration 
number. 

On  the  r,1*1  iteration,  the  Y^'s  computed  during  iteration  n  -  1  be¬ 
come  estimates  of  the  Y^'s,  and  new  Y^'s  are  computed  as  follows: 

Y(n,t)  •  minimum  [Y<n  -  l.J)  ♦  C  |, 

(i.J)  J  (6) 

in  the  system 

again  for  all  i  4  r  and  Y(n,r)  0. 

The  quantity  Y(n,i)  is  interprated  ss  the  minimum  cost  of  a  path 
starting  from  node  i  that  contains  exactly  «  arcs,  unless  the  terminal 

is  on  the  path,  in  which  case  the  path  terminates  «t  node  r.  If  the 

* 

cost,  C^,  around  every  loop  in  the  system  is  positive,  then  an  n  exists 
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*  * 

such  that  for  all  n  a  n  ,  Y(n,i)  ■  Y(n  ,i).  We  terminate  the  iterative 
process  when  this  condition  is  met.  That  is,  after  each  iteration  >  1, 
we  test  Y(n,i)  *  Y(n  -  l,i),  and  when  this  condition  is  met  for  all  i 
in  the  system,  we  have  obtained  the  optimal  solution.  We  also  obtain 
another  vector,  g(n,i),  which  has  its  value  set  equal  to  the  j  that 
minimizes  Eq.  (5)  or  (6),  depending  on  the  iteration  number. 

That  the  process  will  terminate  in  a  finite  number  of  steps  is  shown 
by  the  following  argument:  As  n  increases,  eventually  every  path  of  n 
arcs  reaches  the  terminal.  And  when  this  occurs,  Y(n,i)  will  stabilize 
to  the  correct  minimal-cost  value  for  the  path,  since  the  only  ue ?  value 
added  to  Y(n,i)  will  be  Y(n,r)  =  0. 

Equations  (5)  and  (6)  form  the  basis  of  the  model,  which  has  been 
implemented  on  JOSS.  The  value-iterative  algorithm  is  less  restrictive 
and  offers  certain  advantages  over  various  other  techniques  which  might 
be  used.  For  example,  the  model  does  not  require  that  the  number  of 
stages  or  nodes  between  the  starting  point  and  the  terminal  be  stipulated. 
There  is  a  recursive  algorithm  which  is  sometimes  used  and  which,  under 
our  formulation,  would  compute  an  optimal  solution  from  a  particular 
node  i  with  n  more  nodes  between  i  and  the  final  decision  point.  How¬ 
ever,  it  could  be  that  if  the  terminal  is  node  6  and  the  state  of  the 
system  is  at,  say,  node  5,  the  optimal  path  to  the  terminal  might  go 
through  nodes  4,  1,  8,  and  7,  rather  than  going  directly  to  6  from  5. 
Similarly,  a  volicy-iterative  algorithm  would  require  that  a  realizable 
path  from  node  i  to  the  terminal  be  stipulated  before  an  optimal  solu¬ 
tion  could  be  found. 

Our  model  does  not  restrict  the  direction  in  which  the  arcs  con¬ 
necting  nodes  may  go  (i.e.,  paths  may  be  cyclic),  and  it  allows  varying 
numbers  of  arcs  to  lead  out  of  and/or  into  each  nodal  point.  Section  III 
illustrates  these  concepts  and  gives  instructions  on  the  use  of  the  model. 
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III.  THE  JOSS  PROGRAM 


The  JOSS  program  is  stored  in  file  238(SYOP8)  under  Item  1  (DYNAH) . 
After  recall,  the  user  types  "Do  part  1."  to  enter  ail  necessary  param¬ 
eters  of  the  system.  Input  includes  the  total  number  of  nodes,  the 
lowest  node  number,  and  the  terminal  node  number  of  the  system.  Both 
consecutive  and  nonconsecutive  numbered  noder  are  permitted.  In  the 
latter  case,  the  model  requests  a  number  for  each  node  in  the  system. 

The  number  of  arcs  leading  out  of  each  node  is  demanded  as  well  as  the 
node  into  which  the  j t^1  arc  out  of  node  i  goes . 

Costs  for  traversing  (i,j)  may  be  entered  in  part  1  or  recalled 
from  another  stored  item  before  operation  of  the  program  is  initiated. 

If  they  are  recalled  from  another  item,  they  must  be  arrayed  in  the 
vector  c(i,j).  Alternatively,  one  might  define  c(i,j)  to  be  a  function 
by  using  a  "Let"  statement.  The  program  will  accept  either  procedure. 

The  program  goes  on  to  part  2,  which  controls  the  iteration  algo¬ 
rithm.  Since  the  model  needs  only  to  compare  Y(n,i)  and  Y(n  -  l,i)  to 
determine  whether  or  not  an  optimal  solution  has  been  reached,  steps 
are  included  that  delete  all  other  stored  present  cost  values  and  parts 
of  the  program  when  size  requirements  approach  computer  memory  capacity. 
Given  this  feature,  the  model  should  be  able  to  handle  many  problems 
which  would  otherwise  require  large  amounts  of  storage  space.  However, 
it  might  first  be  necessary  to  delete  y  and  g  (present  cost  values  are 
stored  in  array  y,  minimizing  arcs  are  stored  in  array  g)  and  then  re¬ 
call  the  program  before  reusing  it,  if  deletion  occurs.  Both  y  and  g 
are  sparse  arrays. ' 

The  optimal  solution  is  output  as  the  best  arc  to  take  from  each 
noJe  en  route  to  the  terminal.  The  total  minimum  cost  from  each  node 
to  the  terminal  is  also  given,  and  if  storage  space  permits,  the  build¬ 
up  of  the  solution  can  also  be  output  (i.e.,  the  results  from  each  it- 
eration  <  n  ) . 


JOSS  initially  considers  all  elements  of  these  arrays  to  be  zero, 
which  facilitates  our  first  estimate  of  the  Y^'s. 
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As  an  illustrative  example,  consider  the  following  network  system: 


Node  numbers  are  circled;  node  13  is  the  terminal.  The  costs  for  tra¬ 
versing  the  various  arcs  are  shown  alongside  each  arc.  Any  node  might 
be  the  current  state,  node  13  being  the  state  at  the  end  of  the  final 
decision.  To  illustrate,  a  path  along  the  arcs  (1,3),  (3,7),  (7,8), 
and  (8,13)  represents  the  current  decision  to  go  from  node  1  to  node  3, 
the  subsequent  decision  to  go  from  node  3  to  node  7,  etc. 

In  a  general  sense,  the  network  represents  the  possible  connections 
between  decisions  to  be  made  and  the  associated  cost  of  going  from  one 
decision  to  another.  For  example,  the  different  arcs  into  node  9  might 
represent  alternative  decisions  in  buying  or  selling. 

The  program  requires  11  iterations  to  solve  the  network.  The  solu- 

* 

tion  is  giver,  at  the  top  of  the  following  page. 

See  Appendix  A  for  the  input,  optimal  solution,  and  solutions 
buildup  to  this  network.  In  the  example  of  Appendix  A,  the  terminal 
point  was  changed  ‘o  node  5  and  the  optimal  solution  recomputed. 
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Best  ! 

Path 

Minimum 
Cost  to 
Terminal 

From 

To 

1 

3 

43 

2 

8 

38 

3 

7 

36 

4 

9 

32 

5 

6 

39 

6 

8 

24 

7 

8 

26 

8 

13 

17 

9 

11 

1 

30 

10 

13 

16 

11 

10 

21 

12 

8 

22 

Notice  that  this  solution  satisfies  the  principle  of  optimality  defined 
earlier. 

To  investigate  how  the  optimal  set  of  nodes  changes  with  changes 
in  the  terminal  point,  we  simply  set  T  equal  to  the  desired  node  and 
type  "Do  part  2.".  If  only  costs  are  to  be  changed,  type  "Do  part  25.". 

Each  node  which  has  at  least  one  exit  arc  is  included  in  the  solu¬ 
tion.  In  case  of  dead  ends  (i.e.,  nodes  with  no  exit  arcs),  an  attempt 
has  been  made  to  program  around  them  by  assigning  a  very  high  cost. 

By  the  inclusion  of  random  elements,  the  model  could  be  extended 
to  take  into  account  the  impact  of  uncertainty  on  an  optimal  cision 
process  (this  extension  has  not  yet  been  made).  In  such  cases,  uncer¬ 
tainties  are  viewed  as  imperfect  predictions  to  be  characterized  by 
probability  distributions  for  the  different  possible  events.  Stochas¬ 
tic  versions  of  many  dynamic-programming  models  are  often  not  much  more 
difficult  to  solve  than  their  deterministic  counterparts.  In  the  pres¬ 
ent  case,  such  a  model  would  be  solving  for  a  path  having  the  least 
expected  cost  (i.e.,  the  "most  probable"  path). 
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Appendix  A 

ILLUSTRATIVE  PROBLEM;  INPUT  AND  OUTPUT 


Use  file  238  (SYOP8). 

Roger. 

Recall  item  1  (DYNAM). 

Done. 

Do  part  1. 

Number  of  nodes  in  the  system  *  13 
Lowest  node  number  in  the  system  *  1 
Terminal  node  number  a  13 

Are  node  numbers  consecutive?  (Answer :Yes=l}No*2)  a  1 
Into  array  A(i),  enter  number  of  arcs  leading  out  of  node  i. 
A(  1 )  a  2 
A(2)  =  4 
A(3)  =  2 
A(4)  a  3 
A(5)  a  5 
A(6)  a  3 
A(7)  a  2 
A( 8)  a  3 
A(9)  a  3 
A(10)  a  3 
A( 11 )  a  3 
AC  12)  a  2 
A(13)  a  0 

Into  array  0(1, j),  enter  node  number  into  which  the  j-th  arc 
out  of  node  i  goes. 

0(1,1)  =  3 

0(1,2)  a  4 
0(2,1)  a  1 

0(2,2)  a  3 

0(2,3)  =  7 
0(2,4)  a  8 
0(3,1)  a  2 
0(3,2)  *  7 
0(4,1)  a  1 
0(4,2)  *  S 
0(4,3)  a  9 
0(5,1)  a  3 
0(5,2)  »  1 
0(5,3)  a  4 
0(5,4)  a  9 
0(5,5)  a  6 
0(6,1)  a  5 

0(6,2)  ■  7 
0(6,3)  a  8 
0(7,1)  a  6 
0(7,2)  a  8 
0(8,1)  a  6 
0(8,2)  a  12 
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0(8,3)  =  13 
0(9,1)  =  5 
0(9,2)  =  11 
0(9,3)  =  12 
0(10,1)  =  4 
0(10,2)  =  11 
0(10,3)  *  13 
0(11,1)  »  9 
0(11,2)  *  10 
0(11,3)  =  12 
0(12,1)  =  11 
0(12,2)  =  8 

Are  costs  to  be  entered  here?  (YesaljNo=2)  =  1 
Into  array  c(i,j),  enter  the  cost  for  traveling  from  node  i 
to  node  j,  i.e.,  the  cost  for  traversing  (i,j). 
c(l,3)  »  7 
c(l,4 )  a  12 
c(2,l)  a  12 

c(2,3)  a  5 
c(2,7 )  a  12 
c( 2,8)  a  21 
c(3,2)  =  5 
c(3,7)  a  10 
c(4,l)  =  12 
C(4,5)  a  7 
c(4,9)  a  2 
c( 5,3)  a  3 
c(5,l)  a  6 
c(5,4)  a  7 
c(5,9)  a  13 
c(5,6)  a  15 
c(C ,5)  a  8 
c(6,7)  a  ft 
c(6,8)  a  7 
c(7,6)  a  4 
c(7,8)  a  4 

C( 8,6  )  a  11 

c(8,12)  a  1 
c(8,13)  a  17 
c(9,5)  a  9 
c(9,ll  )  a  9 
c(9,12)  a  16 
C( 10 ,4  )  a  7 
C(10,ll)  a  4 
C(10,13)  a  U 
c(  1 1,9 )  a  -.4 
C(ll,10)  a  5 
c(ll  ,12)  a  *• 
c( 12 ,11 )  a  j 
C(l?,8)  ■ 
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Number  of  iterations  -  11.  Optimal  set  of  nodes  are  as  follows 

From  node  Go  to  node  Min  cost  to  terminaK  13) 


1 

3 

43.00 

2 

8 

38.00 

3 

7 

36.00 

4 

9 

32.00 

5 

6 

39.00 

6 

8 

24.00 

7 

8 

26.00 

8 

13 

17.00 

9 

11 

30.00 

10 

13 

16.00 

11 

10 

21.00 

12 

8 

22.00 

Output  buildup  of  optimal  solution?  Answer(Yes=l ;No*2)  =  1 


Iteration  number  =  1. 

From  node  Go  to  node 

State  of  the  system  follows: 
Present  Cost 

1 

3 

7.00 

2 

3 

5.00 

3 

2 

5.00 

4 

9 

2.00 

5 

3 

3.00 

6 

8 

7.00 

7 

6 

4.00 

O 

12 

1.00 

9 

11 

9.00 

10 

11 

4.00 

11 

12 

3.00 

12 

11 

3.00 

Iteration 
From  node 

number 

Go 

«  2. 
to  node 

State  of  the  system  follows 
Present  Cost 

1 

3 

12.00 

2 

3 

10.00 

3 

2 

10.00 

4 

5 

10.00 

5 

3 

8.00 

6 

3 

8.00 

7 

3 

10.00 

8 

12 

4.00 

4 

11 

12.00 

10 

11 

7.00 

11 

12 

6. 00 

12 

3 

6.00 
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Iteration 
From  node 

number 

Go 

=  3. 

to  node 

State  of  the  system  follows: 
Present  Cost 

1 

3 

17.00 

2 

3 

15.00 

3 

2 

15.00 

4 

9 

14.00 

5 

3 

13.00 

6 

8 

11.00 

7 

6 

12.00 

3 

12 

7.00 

9 

11 

15.00 

10 

11 

10.00 

11 

12 

9.00 

12 

8 

9.00 

Iteration  number  =  4.  State  of  the  system  follows: 

From  node  Go  to  node  Present  Cost 

1 

3 

22.00 

2 

3 

20.00 

3 

2 

20.00 

4 

9 

17.00 

5 

3 

18.00 

6 

8 

14.00 

7 

6 

15.00 

8 

12 

10.00 

9 

11 

18.00 

10 

11 

13.00 

11 

12 

12.00 

12 

8 

12.00 

Iteration 
"ror.  node 

number 

Go 

*  5, 

to  node 

State  of  the  system  follows: 
Present  Cost 

1 

3 

27.00 

2 

3 

25.00 

3 

7 

25.00 

4 

3 

20.00 

5 

3 

23.00 

6 

a 

17.00 

7 

6 

18.00 

3 

12 

13.00 

3 

11 

21.00 

1  •*: 

a  • 

n 

15.30 

*  * 

•  « 

i‘..o: 

;  « 

3 

n.oc 

-13 
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Iterat ion 
from  node 

number 

Go 

r  O. 

to  node 

State  of  the  svstem  fellow';: 
Present  Cost 

u 

41. CO 

2 

9 

38.00 

3 

7 

36.00 

u 

9 

32.00 

5 

4 

36.00 

6 

3 

24.00 

7 

3 

26.00 

3 

13 

17.00 

9 

11 

30.00 

10 

13 

16.00 

11 

10 

21.00 

12 

8 

22.00 

Iteration 
From  node 

number 

Go 

=  10. 
to  node 

State  of  the  system  follows: 
Present  Cost 

1 

3 

43.00 

2 

3 

38.00 

3 

7 

36.00 

4 

9 

32.00 

5 

6 

39.00 

6 

3 

24.00 

*7 

8 

26.00 

3 

13 

17.00 

9 

11 

30.00 

1C 

13 

16.00 

11 

10 

21.00 

« 

*  W 

3 

22.00 

Set  T  •  5 
Do  part  2 
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Number  of  iterations  *  9.  Optimal  set  of  nodes  are  as  follows 

From  node  Go  to  node  Min  cost  to  terminaK  5) 


1  4  19.00 

2  7  24.00 

3  7  22.00 

4  5  7.00 

6  5  8.00 

7  6  12.00 

8  6  19.00 

9  5  9.00 

10  4  14.00 

11  10  19.00 

12  11  22.00 


Output  buildup  of  optimal  solution?  Answer(Yes«l;No»2)  * 


Appendix  B 


PROGRAM  LISTING 


Use  rile  238  (SYOP8 ) . 

Roger. 

Recall  item  1  (DYNAM). 

Done. 

Tyne  all, size. 

1.10  Demand  N  as  "Number  of  nodes  in  the  system". 

1.11  Demand  L  as  "Lowest  node  number  in  the  system". 

1.12  Demand  T  as  "Terminal  node  number". 

1.15  Demand  q  as  "Are  node  numbers  consecutive?  ( Answer :Y *3=1; No* 2}". 
1.17  Do  part  [q=i:10;ll], 

1.20  Type  "Into  array  A(i),  enter  number  of  arcs  leading  out  of  node  i. 

1.24  Do  part  12  for  i=l(l)N. 

1.30  Type  "Into  array  0(i,j),  enter  node  number  into  which  the  j-th  arc 

1.31  Type  "out  of  node  i  goes.". 

1.34  Do  part  13  for  i=l(l)N. 

1.36  Demand  q  as  "Are  costs  to  be  entered  here?  (Yes=l;No=2)". 

1.37  To  part  2  if  q=2. 

1.40  Type  "Into  array  c(i,j),  enter  the  cost  for  traveling  from  node  i" 

1.41  Type  "to  node  j,  i.e.,  the  cost  for  traversing  (i,j).". 

1.44  Do  part  14  for  i=l(l)N. 

1.70  To  part  2. 

2.09  Set  e=l. 

2.10  Set  k=0. 

2.11  Set  f=0. 

2.15  Set  k=k+l. 

2.16  Set  h=k-l. 

2.17  Do  part  20  if  k>2  and  (size-1700 )>0. 

2.13  Do  part  3  for  i=l(l)N. 

2.20  Do  part  5  for  i=l(l)N. 

2.24  To  step  [f*-0:2, 15;6,10], 

3.10  Set  y(k,n(i))s[n(i)=T.j0;Q]. 

3.<:0  Dc  part  4  for  j»l(l  )A(n(i>). 

4.10  Done  if  ly(h,0(n(i), j ) )+c(n(i),0(n(i), j ) )]*y(k,n(i)), 

4.13  Set  g(k,n(i) )=[0(n(i),i )=T:T;g(k,n(i))*T:g(k,n(i));0(n(i)tj )]. 

5.10  Suit  if  v(k,n(i))*y(k-l,n(i)). 

3.12  Done  if  i*'A. 


6.10  Pane. 

6.11  Tyne  k  in  form  1. 

6.13  Line. 

6.14  Type  T  in  form  2. 

6.15  Type  form  3. 

6.16  Do  part  7  for  i=l(l)N. 

6.17  Type 

6.20  Demand  q  as  "Output  buildup  of  optimal  solution?  Answer(Yes=l;No=2)1 
6.25  Do  part  8  for  z=l(l)h  if  q=l. 

7.10  Done  if  n(i)=T  or  A(n(i))=0. 

7.15  Type  n(i),g(k,n(i)),y(ktn(i))  in  form  4. 

8.01 
8.02 
3.03 
8.04 

9.01  Done  if  n(i)=T  or  A(n(i))=0. 

9.02  Type  n(i),g(z,n(i)),y(z,n<i))  in  form  4. 

10.1  Do  step  10,5  for  i=l(l)N. 

10.2  Done. 

10.5  Set  n(i)*i+L-l. 

11.1  Type  "Into  array  n(i).  enter  number  of  the  ith  node.". 

11.2  Do  step  11.5  for  i=l(l)N. 

11.3  Done. 

11.5  Demand  n(i). 

12.1  Demand  A(n(i)). 

13.1  Done  if  A(n(i))S0. 

13.2  Do  step  13.5  for  j=l(l)A(i). 

13.3  Done. 

13.5  Demand  0(n(i),j). 

14. 1  Done  if  A(i)s0, 

14.2  Do  step  14.5  for  j=l(l)A(i). 

14.3  Done. 

14.5  Demand  c(n(i),0(n(i), j )). 

20.1  Set  b=k-2. 

20.2  Do  part  21  for  d=b(-l)e, 

20.3  Set  e=b+l, 

20.4  Delete  part  1,'part  8, part  9, step  6. 20, step  6. 25, step  20.4. 

21.1  Do  part  22  for  i*l(l)N. 

22.1  Done  if  n(i)=T. 

22.2  Delete  g(d,n(i)),  y(d,n(i)). 


Type 

Type  z  in  form  5. 

Type  form  6,  form  3. 

Do  part  9  for  .-1(1)N. 


25.1  To  step  1.44. 
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Form  1: 

Number  of  iterations  =  _ .  Optimal  set  of  nodes  are  as  follows: 


Form  2: 

From  node  Go  to  node  Min  cost  to  terrains  1( _ ) 

Form  3 : 


Form  4: 


Form  3: 

Iteration  number  = _ .  State  of  the  system  follows: 

Form  6: 

From  node  Go  to  node  Present  Cost 

Q:  [A(n(i))SC:10*6i  min[j=l(l)A(n(i)):y(h,0(n(i),j))+c(n(i),0(n(i),j))]  1 

£■(0,0)  =0 

2  is  sparse 

v(C,0)  a  0 

y  is  snarse 

size  =  513 
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